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Abstract 

Flavor changing neutral currents arise in the SU(3) C ® SU {A) l®U {1) x extension of the standard 
model because anomaly cancellation among the fermion families requires one generation of quarks to 
transform differently from the other two under the gauge group. In the weak basis the distinction 
between quark families is meaningless. However, in the mass eigenstates basis, the Cabibbo- 
Kobayashi-Maskawa mixing matrix motivates us to classify left-handed quarks in families. In 
this sense there are, in principle, three different assignments of quark weak eigenstates into mass 
eigenstates. In this work, by using measurements at the Z-pole, atomic parity violation data and 
experimental input from neutral meson mixing, we examine two different models without exotic 
electric charges based on the 3-4-1 symmetry, and address the effects of quark family nonuniversality 
on the bounds on the mixing angle between two of the neutral currents present in the models and 
on the mass scales Mz 2 and Mz 3 of the new neutral gauge bosons predicted by the theory. The 
heaviest family of quarks must transform differently in order to keep lower bounds on Mz 2 and 
Mz 3 as low as possible without violating experimental constraints. 

PACS numbers: 12.10.Dm, 12.60.Cn, 12.15.Mm 
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I. INTRODUCTION 



Two of the most mysterious aspects in modern particle physics are the masses and mixings 
of the elementary fermions and the number of fermion generations in nature: the flavour 
problem. The standard model (SM), in which each family is anomalyfree by itself, does 
not fix the number of generations except by the indirect bound coming from the asymptotic 
freedom of QCD according to which this number must be less than 9. On the other hand it is 
known, on the theoretical side, that the flavor democracy approach [l| and some mechanisms 
of dynamical electroweak symmetry breaking [2J favor the existence of a fourth family, and, 
on the experimental side, that precision electroweak data do not totally exclude it 0]. 
Moreover, two and even three additional generations could also be allowed Q]. However, in 
the SM, the LEP data on invisible Z boson decay show that there are three SM families 
with light neutrinos 

Two alternative scenarios, which provide some insight for the solution of this puzzle 
by relating the number of generations to the cancellation of chiral anomalies, have been 
proposed in the literature. In one of them anomalies constrain the number of generations 
provided their cancellation takes place either in a nonsupersymmetric SU(3) C ® SU{2)l <8> 
U(1)y theory that lives in a six-dimensional spacetime 0, or in a sixdimensional (1,1) 
supersymmetric gauge theory Q. In the other one the SM is extended either to the gauge 
group SU{3) C ®SU{3) L ®U{1) Y (the 3-3-1 model) @,Q or to the gauge symmetry SU{3) C ® 



SU(A)l®U(1)y (the 3-4-1 model) [10|, llll. Il2|. with anomalies cancelling among the families 



(three-family models) and not family by family as in the SM. In the 3-3-1 extension this 
happens only if we have an equal number of left-handed triplets and antitriplets, taking 
into account the color degree of freedom. Correspondingly, an equal number of 4-plets and 
4*-plets is required in the 3-4-1 extension. As a consequence, the number of fermion families 
Nf must be divisible by the number of colors N c of SU(3) C , being Nf = N c = 3 the simplest 
solution. 

One additional motivation to study the second scenario comes from the fact that it has 
been recently recognized as the simplest SM extension required for the implementation of the 
little Higgs mechanism [l3[ . Even though we will not be concerned here with this alternative 
proposal to solve the so-called hierarchy problem, we notice that in the simplest little Higgs 
scenario the SM gauge group is enlarged to SU(3)l <%> U(l)x- This model, however, lacks 
a quartic Higgs coupling which can be generated in a SU(4) L ® U(l)x extension [13j. The 



complete anomaly-free fermion sector for these two little Higgs models has been studied in 
detail in Ref. [3], with direct generalization to SU(N)l®U(1)x with N > 4 but, at present, 
there is not motivation to go beyond N — 4. Conspicuously, in the little Higgs scenario both 
the 3-3-1 extension and the 3-4-1 one are three-family models in which all the exotic fermion 
fields have only ordinary electric charges. 

In this paper we will be involved with the 3-4-1 extension of the SM. In this regard, a 
recent systematic analysis has shown that, by restricting the fermion field representations 
to particles without exotic electric charges (that is, electric charges different from ±2/3 and 
±1/3 for exotic quarks and different from and ±1 for exotic leptons) and by paying due 
attention to anomaly cancellation, a few different models are obtained; while by relaxing 
the condition of nonexistence of exotic electric charges, an infinite number of models can 
be generated [13]. The restriction to ordinary electric charges in the fermion, gauge boson 
and scalar sectors, allows only for two different possibilities for the simultaneous values of 
the parameters b and c in the most general expression for the electric charge generator in 
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SU(4) L ® U(l) x 

Q = aT 3L + -^=T 8L + A=T 15L + Xh, (1) 

where = Ajl/2 (A»l are the Gell-Mann matrices for SU(4)l normalized as Tr(AjAj) = 
25ij), 1 4 = Dg(l, 1, 1, 1) is the diagonal 4x4 unit matrix, and a = 1 gives the usual isospin 
of the electroweak interaction. These possibilities are: b = c = 1 and b = 1, c = —2, which 
become a convenient classification scheme for these type of models. Four of the identified 
models without exotic electric charges are three-family models. Two of them are models for 



which b = c = 1 and have been analyzed in Refs. [15| and [161 ] . The other two models belong 
to the class for which b = 1, c = —2 and have been studied in Refs. [13] and [l8| . 

3-4-1 models containing exotic electric charges have been also considered in the literature 
floL HI]. In this case a particular embedding of the SM gauge group into SU(3) C ® SU (4) l (g) 
U(l)x depends on the physical motivation of the model to be constructed. The model in 
Ref. [10(, for example, has been proposed with the goal of including right-handed neutrinos 
in the fermion spectrum from the start. 

Models based on the SU(3) C ® SU{A)l <8> U{l)x gauge symmetry predict the existence 
of three massive neutral currents which mix with each other. They are, the usual neutral 
current of the SM associated to the Z gauge boson, and two new associated to the gauge 
bosons Z' and Z" . Unlike models containing exotic electric charges, for models with only 
ordinary electric charges the mixing can be constrained to occur between Z and Z' only 



16|, [13]. This fact produces an enormous simplification in the study of the low energy 
deviations of the Z couplings to the SM families [l3[| . On the other hand, after the breakdown 
of the 3-4-1 symmetry down to SU(3) C (g) U(1)q, the left-handed couplings of quarks to the 
SM Z boson remain flavor conserving (at low energies the model coincides with the SM); 
but, since anomaly cancellation among generations forces one family of quarks to transform 
differently from the other two, the left-handed couplings of quarks both to Z 1 and Z" are, in 
general, not flavor diagonal. Consequently, flavor changing neutral currents (FCNC) arise. 

With a family of quarks transforming differently under SU(4)l (g) U(l)x, we have three 
possible assignments of weak eigenstates into mass eigenstates. As we will see, the phe- 
nomenological implications of the model will depend on the choice of the quark family being 
different. 

In this work we will constrain ourselves to the case where the mixing occurs between 



Z and Z' only, with Z" = Z% being a mass eigenstate [13j. Then, for two different 3-4-1 
models, one of them representative of the b = c = 1 class and the other one representative 
of the 6=1, c = —2 class, we do a x 2 fit to Z-pole observables and atomic parity violation 
(APV) data in order to constraint the mixing angle 9 between Z and Z' and the mass 
scale Mz 2 of the corresponding physical new neutral gauge boson. The main purpose will 
be to examine how much these bounds depend on the three different assignments of quark 
gauge eigenstates into mass eigenstates. Next, for the same two different 3-4-1 models and 
for the three possible assignments, we will impose constraints on the parameters Mz 2 and 
Mz 3 coming from neutral meson mixing in the analysis of the FCNC effects present in the 
models. The outcome of the analysis will be then used to establish which quark family must 
transform differently in order to keep the lower bounds on Mz 2 and Mz 3 as low as possible. 

This paper is organized as follows. In the next section we review the 3-4-1 models to 
be studied with the emphasis done on the aspects relevant to the analysis proposed in the 
previous paragraph. In Sec. II III we use electroweak measurements at the Z-pole, APV data 
and experimental input from neutral meson mixing in order to obtain family-dependent 
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bounds on the parameters of the models. Finally, in the last section, we summarize and 
present our conclusions. 



II. 3-4-1 MODELS 

As stated, we will consider models without exotic electric charges based on the 3-4-1 
symmetry, each one characterized by the values of the parameters b and c in the electric 
charge operator in Eq. (TJQ), namely: fe = c= lor6=l, c = —2. There exists two anomaly- 
free models of each type [12J. We will select one representative model of the b = c = 1 class 
and one representative model of the 6=1, c = —2 class. 

In what follows we assume the symmetry breaking pattern 

SU(3) C ®SU(4) L ® U(l) x 

SU(3) C ®SU{3) L ®U(1) Z 
SU(3) C ®SU(2) L ®U{1) Y 
^ SU(3) C ®U(1) Q , (2) 

where SU(3) C ® SU(3)l <8> U(l)z refers to the three-family 3-3-1 structure introduced in 
Ref. 0], and V, V, v, v' are the vacuum expectation values of four Higgs 4-plets which will 
be specified for each model below. We impose the hierarchy V ~ V » v ~ v' ~ 174 GeV. 

The gauge couplings and gx, associated with the groups S77(4)l and U(l)x, respec- 
tively, are defined through the covariant derivative for 4-plets as: iD^ 1 = id^ 1 — g4,\LaA^/2 — 

gxXB». 



A. Model A: b = c = 1 



This is Model B in Ref. 121 ] . It has the anomaly- free fermion content displayed in Tabled 
where i — 1, 2 and a = 1,2,3 are family indexes and the numbers in parentheses refer to 
the [SU(3)c, S77(4) L , U(l)x] quantum numbers, respectively. U{ and XJ[ are exotic quarks 
of electric charge 2/3, while D 3 and D' 3 are exotic quarks of electric charge —1/3. E~ and 
E'~ are exotic electrons. Notice that universality for the known leptons in the three families 
is present at the tree level in the weak basis. So, FCNC do not occur in the lepton sector, 
up to possible mixing with the exotic fields. 

From Table [I] we can identify three different realizations in the mass basis as shown in 
Table [IT] 

The symmetry breaking and masses for all the fermion fields (except for h>® a ) are produced 



by the set of Higgs scalars [16 



(fi) = ((0?,0+,0' 1 + ,0' 1 ' + )) = (i;,O,O,O)~[l,4*,3/4], 
($) = ((0 2 -,0^0 , 2 °,0n) = (0,r/,0,0)~ [1,4*, -1/4], 
= ((03 >03>03°> 03°)) = (0,0,V,0)~ [1,4*, -1/4], 
{<&) = mAlA'2A?)) = (0,0,0,0 ~ [1,4*, -1/4]. (3) 
When the 3-4-1 symmetry is broken to the SM, we get the gauge matching conditions 

g* = g, and Y 2 = ¥x + ^ (4) 
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TABLE I: Anomaly-free fermion content of Model A. 



QiL 



(di\ 

Ui 

Ui 
\U'J 



[3,4*, 



* 5 

12J 



1 ' L 



a iL 



u 



iL 



[3M,-g] 



U iL 



[3M,-§] 



TTlC 

u iL 



[3M,-|] 



Q 3 L 



^3 



[3,4,- 



12 J 



3L 



[3M,-|] 



<7 C 
«3L 



[3*, 1,4] 



U 3 L 



[1,4,-f] 



[1,1,1] 



[1,1,1] 



[1,1,1] 



TABLE II: Three different assignments of symmetry eigenstates into mass eigenstates for Model 
A. 



Assignment Al 



Assignment A2 



Assignment A3 



QiL 



Q 3 L 



( d,s \ 

u, c 

\u[,uU 

( t \ 

b 

D 3 



QiL = 



Q3L 



( d,b \ 

u, t 
U U U 3 

\u[,uU 

( c \ 

s 

D 2 
\D> 2 ) 



QiL = 



Q3L 



( S ' h \ 

C, t 

u 2l u 3 

( u\ 

d 

D 1 



where g and g' are the gauge coupling constants of the SU (2) l and U(l)y groups of the SM, 
respectively. 

Mixing between ordinary and exotic fermions and violation of unitarity of the Cabibbo- 
Kobayashi-Maskawa (CKM) mixing matrix can be avoided by introducing an anomaly-free 
discrete Z 2 symmetry with assignments of Z 2 charge qz given by 

gz(QaL,<L,CL,^, e aL,01,02) = 0, 

qziU^U^D^D^E^E'^fafa) = 1, (5) 

After the symmetry breaking, the Yukawa couplings allowed by the gauge invariance 
and the Z 2 symmetry produce for up- and down-type quarks, in the basis {ui,u 2 ,u 3 , 
Ui, U 2 , U[, U' 2 ) and (di, d 2) d 3 , D 3 , D' 3 ), respectively, block diagonal mass matrices of the form 
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and 

m — (i* s Mi)- p> 

and similarly for the charged leptons. 

For our purposes, we will be mainly interested in the neutral gauge boson sector which 
consists of four physical fields: the massless photon and the massive gauge bosons Z^, 
Z'^ and Z"^. In terms of the electroweak basis, they are given by 

A» = S W A% + C W Y» , 
Z^ = C W A% - S W Y» , 

Z» = - T 2 w /2f' 2 U + _ 



Z"» = A%/V3-^j2/3AZ 5 , (8) 

where 

Y" = ^ + ^f) + (1 - (9) 

is the field to be identified as the Y hypercharge associated with the SM abelian gauge 
boson. T w = Sw/Cw, where Sw is the sine of the electroweak mixing angle defined as 

Sw = V2gx/^g 2 x +2gl and C w = yjl - S 2 W . 

Since we are interested in the low energy phenomenology of the model, we can choose 
V ~ V . Moreover we will consider the particular case v ~ v', for which the current 
Z' ,fl = Z% decouples from the other two and acquires a squared mass M| 3 = (g\/2)V 2 (l3j . 
The remaining mixing between Z^ and Z 1 ^ is parametrized by the mixing angle 9 as 

Z{ = Z^cosd + Z'^sme , 

Z% = — Z^ sin 9 -\- Z 1 ^ 1 cos (10) 
where and Z% are the mass eigenstates and 



2^25v 2 Sl, 



tan(20) - ^ 2L . 2/o4 , ^ 4 \ , i I^2~' C 11 ) 

with 5 = g x /(2g 4 ). 

The Lagrangian for neutral currents can be written as — £ NC = eA^J^EM) + 
{g A /C w )Z»J„(Z) + (g x /V2)Z'» J,{Z>) + (g 4 /2)Z"»J„(Z»), with 

2 _ 2 

--(d 3lfl d 3 + D 3lfl D 3 + D' 3 -f^D' 3 

2 

i=l 
3 

a=l 

= £<?/iV, (12) 
/ 
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TABLE III: The Z{ — ► // couplings for Model A. 



/ 




5 (A) (/)iA 




1 4<? 2 

(I 3 w ){cos9 + Tsm6) 


±(cos0 + Tsin0) 


d 3 


(-5 + 3 ) cos + ^ T ( C W + T) sin 


— \ (cos — TC2W sin 0) 


D 3 


3 W cos0 iT(l 3 W )sin0 


-iTC^sine 


D', 


2S ™ cos6 lT(l 7 ^)sin# 


-±TC^sin0 




( J + 2S f )(cos6> + Tsin#) 


-±(cos0 + Tsin0) 

2 V / 


U\ 2 


(1 ^)cos0 lr(c*+ 5S } r )sme 

^ 2 H 


i (cos 6* — TCW sin (9) 


U X , 2 


45 3 w cos0+ ^T(l £ 5^) sin0 






4 ^ cos#+ |T(1 Y 5^) sin0 


iTC^sin0 


^1,2,3 


i(cos# + Tsin#) 


i(cos0 + Tsin0) 


e l,2,3 


(-i + 25^) cos + T(± + S^) sin 6 


— | (cos — TC2W sin 0) 


1,2,3 


cos + ±T (-1 + 55^) sin 


-iTC^sin^ 


rr'- 

1,2,3 


2S% v cos9+ £T(-l + 5S^)sin0 


-±TC^sin0 



J^Z) = J M)L (Z) - S^J M (EM), (13) 

J^(Z') = J^Z') - T w J^(EM), (14) 
J M (Z") = -D 3L ^D 3L + D' 3Ll(i D' 3L 

- £ {E- aLlli E~ L - E'- L ^E'- L ), (15) 



where e = <?5V = <74<SV = gxCwyl — > is the electric charge, is the electric 

charge of the fermion / in units of e and J^(EM) is the electromagnetic current. It is 
important to remark that in this model the Z" current couples only to exotic fields as can 
be seen from Eq. (1151) . 

The left-handed currents in J^{Z) and J^(Z') are 

J^,l{Z) = ~[«3l7/x u 3L - dsLlpdsL 

2 

1=1 

3 

a=l 

= Y. T ±fhl»fL, (16) 
/ 



7 



TABLE IV: The Z% — ► // couplings for Model A. 



/ 


g {A) (fhv 


5 (A) (/)2A 




(1 3 w )(sm9 Tcosfl) 

,i 9 1 ? 2 , i , o S 12 , 

(5 " 3 ) Sil1 9 + 5 T ( C W + T) COS 


±(-sin0 + Tcos0) 


d 3 


i (sin + TC2H/ cos 6*) 


D 3 


3 W sin0 ^T(l 3 W )cose 


-iTC^cosfl 


D', 


2 ^sin6> iT(l 7 3^) cos 9 


-iTC^costf 


d\,2 


(1 2S * w )(sm9 Tcos#) 


-±(-sin0 + Tcos0) 


Ul,2 


(J 4S f)sinfl iT(C^ + ^)cos0 


— | (sin + TC2VK cos 9) 




4 3^sin0+ *T(1 1 3 1 5^)cos0 


\TClrCos9 


U[, 2 


4 ^sin^+iT(l 1 3 1 ^)cos0 


iTC^cose 


^1,2,3 


±(-sin0 + Tcos#) 


±(-sin0 + Tcos0) 


e l,2,3 


(±-2S^)sin0 + T(± + ^)cos0 


| (sin 9 + TC2W cos 9) 


1,2,3 


-25^ sin + ±T(-1 + 5S^) cos 9 


-±TC^cos0 


rr'- 

1,2,3 


-2S^sm9 + 5T(-l + 55^)cos0 


-±TC^cos0 



J^(Z') = (2T w )- 1 {(l + T^)n 3 L7^3L 
+(1 -T^)d 3 i7 iU d 3L 

-D 3Llfl D 3L - D' 3Llfl D' 3L 
2 

- Ylii 1 + T w)diLl^d iL 

i=l 

+ (1 - T^UiL-y^UiL 

-U iL %U iL - U' iLl ^U' iL ] 
3 

+ [(1 + T^)^ aL 7 M z/ aL 

= zZ T ifhl,h, (17) 

where T 4 j = Dg(l/2, — 1/2, 0, 0) is the third component of the weak isospin and TL = 

(l/2T w )Dg(l + Tyy, 1 — -1, -1)= T w A 3 /2 + (1/T W )(X S /V3 + A15/V6) is a convenient 
4x4 diagonal matrix, both of them acting on the representation 4 of SU(A)l. The current 
Jfj,(Z) is clearly recognized as the generalization of the neutral current of the SM. Thus, we 
identify as the neutral gauge boson of the SM. 

From Eq. (ITT)) we can see that the left-handed couplings of Z' to one family of quarks 
are different from the couplings to the other two. This induces FCNC at the tree level 
transmitted by the Z' boson. 

The couplings between the mass eigenstates Zf, Z% and the fermion fields are obtained 
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TABLE V: Anomaly-free fermion content of Model B. 



QiL 



( Ui \ 

di 
Di 

\uj 

[3,4 i] 



[3M,-|] 



iL 



[3M,£] 



D c iL 



[3M,-j] 



Q 3 L 



M 3 \ 

^3 



[3,4* i] 



^3L 



[3M,-|] 



31 



3L 



[3*. 1,4] 



7")/C 



[3*, 1,1] 



iV5 



[1,4*, -i] 



[1,1,1] 



[1,1,1] 



for this model from the Hamiltonian 

^ NC = ^E^E{/7,[^ (A) (/V-^ (A) (/),a75]/}, (18) 

The expressions for g!jy , (i — 1,2) are listed in Tables [TTT] and [TVT where T = 

1/ ^2 — and = — S 1 ^. 



B. Model B: b = 1, c 



This is Model E in Ref . [12| . For this model the anomaly-free fermion structure is given in 
Table |Vj which shows that also in this case universality for the ordinary leptons in the three 
families is present in the weak basis. From this Table we can recognize the three different 
realizations in the mass basis shown in Table I VI I 

The symmetry breaking and masses for all the fermion fields (except for the neutral 



leptons) are achieved with the set of Higgs scalars 17 



*D = ((^r, <f>l <f>?,<f>'r)) = (o,t>,o,o)~ [1,4*, -1/2], 

= ((0 2 -,0^,0?,0 / 2 -)) = (O,O,y,O)~[l,4*,-l/2], 

£> = ((03,03>03~ 03°)) = («', 0,0,0) ~ [1,4, -1/2], 

T' 



= {{^IAIAaA'!)) = (0,0, 0,V) ~ [1,4,-1/2]. (19) 



The gauge matching conditions now read 



111 

04 = 0, and — = — + —. (20) 

0' 2 0x 2 
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TABLE VI: Three different assignments of symmetry eigenstates into mass eigenstates for Model 
B. 



Assignment Bl 



Assignment B2 



Assignment B3 



QiL 



( u,c \ 

d, s 

V u lt u 2 J 

( b \ 

t 

U 3 
\D 3 J 



QiL 



Q3L 



U, t 

d,b 
D U D 3 

V U!,u 3 J 

( s \ 

c 

U 2 
\D 2 J 



QiL 



\ 



Q3L 



C, t 

s, b 
D 2 ,D 3 

V u 2 ,u 3 J 

( d \ 

u 
Ui 
\DiJ 



For this model the discrete Z 2 symmetry assigns charges qz according to 



qz(QaL,U C aL ^ dC aL^ L aL,e C aL ,(l) 1 ,(j) 3 ) = 0, 

qziK^D^E^h,^) = 1, 



(21) 



and the resulting block diagonal form of the mass matrices for up- and down-type quarks, 
in the basis (ui, u 2 , u 3 , Ui, U 2 ,U 3 ) and (d±, d 2 , d 3 , D 1 , D 2 , D 3 ) respectively, are 



u U 



and 



M. 



dD 



M^ 3 
M& 3 



M d 3x3 
Mg 3 



and similarly for the charged leptons. 

The photon field and the massive neutral gauge bosons are 

A» = S W A% 

+Cw 
Z» = CwA* 

—Sw 

Z» = -J=(l - T w )^ (a% - - T W B", 

Z'"> = 2A%/V6 + AZ 5 /V3, 







9 /1 15 


7s 


V2 






9^15 






V2 



(22) 



(23) 



(24) 



from which we identify the Y hypercharge associated with the SM U(l)y gauge boson as 



73 



At -2 



At, 



15 



V2, 



+ (l-T w ) l ' 2 B». 



(25) 
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Also in this model, for V ~ V and v ~ v', the field Z"^ = Z% decouples and acquires a 
mass M| 3 = (g 2 /2)(V 2 +v 2 ). The mixing angle between and Z'^ is given by 

tan(2 " ) = ^ITWX^ ' (26) 



where the sine of the electroweak mixing angle is defined as Sw = 9x1 y^9x + #1 ■ 
The neutral currents are 

2 2 

J M (EM) = -E(tti7^«i + U^Ui) + u 3 ^^u 3 
6 i=i 

1 2 - 
d i=l 

3 3 
a=l a=l 

= J2lfHf, (27) 

/ 

J,(Z) = J^ L (Z) - S 2 W J,(EM), (28) 
J M (£') = J^ L {Z') - T W J^EM), (29) 



2 
i=l 

-UiLl^U iL ) - dsLl^L - «3L7m M 3L 

+U 3L 1^U 3 l + D 3L j^D 3L 

3 

+ ^(-^7/^ - VeaLl^eaL 

+N° aL ^N° aL + E- Llfl E~ L ), (30) 

Note that J^(Z") is a pure left-handed current and that, notwithstanding the extra 
neutral gauge boson Z^' does not mix neither with Z^ nor with Z'^ (for the particular case 
V ~ V and f — f '), it still couples nondiagonally to ordinary fermions. Thus, at low energy, 
we have tree-level FCNC transmitted by Z" 

The left-handed currents in ( 1281) and ([29]) are 

1 2 

* i=l 

-(d~3LJitd 3L - M3L7^ M 3L) 
3 

a=l 

= E^ff^h, (31) 
/ 
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TABLE VII: The — ► // couplings for Model B. 



/ 



9 {B) (f) 



IV 



9 {B) (f) 



I A 



«1,2,3 

dl,2,3 

#1,2,3 

^1,2,3 

e l,2,3 
^1,2,3 

JVf.2,3 
E l~2,3 



cos6>(± 



^2 3 
1 , 2Sg 



COS + 



? q2 

6(C 2 iv) 1/2 W 
c-2 
172 "V 



sin 6 



6(CW) 1/2 W 

3- — " 1 2 (c 2W y/2^~" 1 ) 



7Sl 



AS 2 

. J w cor (9 

3 COSP 2(C 2W ) 



.115^ 
T72A 3 



1) 



cos0(-± + 2S^) + 



5 sin I 



.Q2 



2 COS0+ 2(( , m)1/2 ^ 



2(C 2W r)V2 W 

sin 8 q2 



sin 



-C 1 



2{c 2W y/^w 
2S W cos 6 + ( C ^)i/ 2 ( 2 ~ 2pw) 



1 r»r>c A _l_ sin 6* n2 
2 COS0 + 2 (C2w)^ 2 W 

o2 
1/2 J l 



- i cos 



2(C 2lv )i/2^ 



sin 6 /^<2 
)T72^1 

nc^W w 



sin 6* /~<2 



_Q 2 

1 Oi, 



cos _ _ 

2 2(CW) 1 / 2 ^ H/ 
2 COSP -t- 2(C2w) i/ 2 ^ 
sin 8 si2 



2{c 2W y/^w 

sin 9 (~<2 

2(C 2W )^ 2 W 



TABLE VIII: The Z% 



ff couplings for Model B. 



/ 



9 (B) (f) 



2V 



9 {B) (f) 



2A 



Wl,2,3 
^1,2,3 
#1,2,3 
^1,2,3 

e l,2,3 
^1,2,3 
<2,3 
#1,2,3 



-sin 0(± - 



45? 



5 cos 6 



2 

2S?rr 



sm 1 



sin + 



3 Sma 2(C 2 iy) 1/2V ■> 



~> 6{c 2W y/ 2S w 

1 j cos 8 q2 

a 7 V 2 

< "< is n I 1 ' 1 1 -j^ \ 

1) 



2(CW)V2 V 3 

cos 8 {H^w 
T72\ 



-±sin0 + 



5 cos 8 q2 
T72'-'' 

cos f n'. 



2{c 2W y/ 2 °w 
2 



r 2 

CQS8 (r) 5 (~l2 

(C 2W y/ 2 ^~ 2 U W) 



-25^ sin + cose f> 5 ^ 2 



1 „• Z) 1 cos 8 q2 

2™"+ 2(c 2W y/ 2 ^w 

1 „• n cos 8 q2 

2 Smt > ~ 2(C 2 -^W W 



cos 6 



2(c 2W y/ 2C w 

cos /^2 

2(C 2 i V ) 1 <' 2 W 
sin _ cos q2 

2 2(C 2 w0 1/2 W 
1 „• a j cos 6> q2 

'2 SmU+ 2jC2^W W 



cos 



r' 2 



2(C 2W ,) 1/2 ^ 
cos 6 

~2(c 2W y/ 2U w 



2 

J^l(Z') = (2T w )~ 1 {J2[T^(u lL ^u iL -d iL ^d iL ) 

i=i 

-DiLlpD iL + 0" iL 7 M f/ iL ] 

+ U3Ll^U 3L - DlLlpPzL 
3 

a=l 

= zZ T ifh^h, (32) 
/ 

where again T 4 j = Dg(l/2, — 1/2, 0, 0) is the third component of the weak isospin, while 
T' Af = (l/2T w )Dg(T^, -T%, -1, 1)= T w A 3 /2 + (l/T iy )(A 8 /(2 v / 3) - A^/v^) is a convenient 
4x4 diagonal matrix, both of them acting on the representation 4 of SU (4) L . Since J^(Z) is 
the generalization of the neutral current present in the SM, we can identify as the neutral 
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gauge boson of the SM. Notice from Eq. (1321) that the left-handed couplings of fermions to 
Z' are flavor-diagonal so, there are not tree-level FCNC transmitted by the Z' gauge boson 
in this model. 

The couplings g\y ', (i = 1,2) of the fermion fields to the mass eigenstates Z± and 
Z% for Model B are listed in Tables rvTTl and IVIIII from which we see that, unlike Model A, 
these couplings are family universal. This is a direct consequence of the fact that, according 
Table [Vj the three families of quarks have the same hypercharge X. 



III. CONSTRAINTS ON THE PARAMETERS 

A. Constraints on the parameter space (6 — Mz 2 ) from Z-pole observables and 
APV data 

We start constrainig the parameter space (6 — Mz 2 ) for Models A and B by using elec- 
troweak observables measured at the Z-pole from the CERN e + e~ collider (LEP), SLAC 
Linear Collider, and atomic parity violation data which are given in Table IIX[ 

The partial decay width for Zf — > ff is given, in the on-shell scheme, by 



N c G F Ml r 3/3 - /3 3 



r(zf-//) = ^ L P/ |__ W)iy ] 

+ P 3 W)lA] 2 }(l + S f )R E wRQCD 



(33) 



where / is an ordinary SM fermion, Zf is the physical gauge boson observed at LEP, 
Nq = 1 for leptons while for quarks Nq = 3(1 + a s /n + lA05a 2 /n 2 — 12.77af/7r 3 ), where 
the 3 is due to color and the factor in parentheses represents the universal part of the 
QCD corrections for massless quarks. Rew are electroweak corrections which include the 
leading order QED corrections given by -Rqed = 1 + 3agj/(47r). -Rqcd ar e further QCD 



corrections, and (3 = yl — Am/j/M Zl is a kinematic factor which can be taken equal to 1 for 
all the SM fermions except for the bottom quark. The factor 5f contains the one loop vertex 
contribution which is negligible for all fermion fields except for the bottom quark for which 
the contribution coming from the top quark at the one loop vertex radiative correction is 
parametrized as Sj, ~ 10~ 2 [— mf/(2M| ) + 1/5]. The parameter p/ is written as 

p f = l + pt + pv, (34) 

where 



Pt w 3G F mf /(8nW2), (35) 

with m t being the top quark pole mass, pv is the tree-level contribution due to the {Z^ — Z'^) 
mixing which can be parametrized as 

p v * (M z jM 2 Zl - 1) sin 2 9. (36) 

Universal electroweak corrections are included in p t and in the couplings g <yk \f)w and 
g < - k \f)\A (k = A, B) of the physical Zf field with ordinary fermions which are written in 
terms of the effective Weinberg angle S^y = (1 + p t /Ty^)S^. 
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TABLE IX: Experimental data and SM values for some observables used for the x 2 fit- 





Experimental results 


SM 


r z [GeV] 


2.4952 ± 0.0023 


2.4968 ± 0.0010 


r(had) [GeV] 


1.7444 ± 0.0020 


1.7434 ± 0.0010 


r(/+r) [MeV] 


83.984 ± 0.086 


83.988 ± 0.016 


Re 


20.804 ± 0.050 


20.758 ±0.011 


Rfj, 


20.785 ± 0.033 


20.758 ± 0.011 


it T 


on v^/i _i_ n c\ak 
ZU. /04 ± U.U40 


on cnQ _i_ n ni 1 


-TLJ, 


91 R99 + OOOfifi 


91 584 + OOOOfi 


R 


1721 ± 0030 


17228 ± 00004 


A (0,e) 
FB 


U.U1410 It u.uuzo 


U.UlOZl It U.UUUZo 


a(°<») 

FB 


0.0169 ± 0.0013 




. (0 t) 
FB 


0.0188 ±0.0017 




FB 


0.0992 ±0.0016 


0.1033 ±0.0007 


A (0,c) 
FB 


0.0707 ± 0.0035 


0.0738 ± 0.0006 


a(0,b) 
FB 


0.0976 ±0.0114 


0.1034 ±0.0007 


A e 


0.15138 ±0.00216 


0.1473 ±0.0011 


\ 


0.142 ±0.015 




A T 


0.136 ±0.015 




A b 


0.923 ±0.020 


0.9348 ± 0.0001 


A c 


0.670 ± 0.027 


0.6679 ± 0.0005 


A s 


0.895 ±0.091 


0.9357 ±0.0001 


n Cs 


-72.62 ± 0.46 


-73.16 ±0.03 


M Zl [Ge\] 


91.1876 ±0.0021 


91.1874 ±0.0021 


m t [GeV] 


170.9 ± 1.8 ±0.6 


171.1 ± 1.9 



The ratios of partial widths are defined as 



and 



_ r z (had) 

= r(z+z-) = e ' /i ' r ' 

^ " T z (had) 



for i] = b,c. 



(37) 



(38) 



We shall use the experimental values: a s (M^ 1 ) = 0.1198, a(M Zl ) 1 = 127.918, and 
sin 2 9\y = 0.2231. For the bottom quark mass we use the running mass m b (M Zl ) at the Z\ 
scale in the MS scheme 20 



m b (M Zl ) = m b 



1 + 



a s {M Zl ] 



71 



(in 



™ b 
Ml 



(39) 



where m b « 4.25 GeV is the pole mass. 

The forward-backward asymmetries at the Z-pole are given by 



A 



(0,/) 

FB 



3 A A 



where A 



f 



2g(f)ivg(f)iA 
9(f)lv + 9(f)l A 



(40) 
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The effective weak charge in atomic parity violation, Qw, can be expressed as 



Q w = -2 [{2Z + N)c lu + (Z + 2N)c ld ] 



(41) 



where Z is the number of protons and N the number of neutrons in the atomic nucleus, and 
ci q = 2g(e)iAg(q)iv {l — u,d). Notice that the values of the coefficients c\ q depend, for each 
model, on the assignment of quark gauge eigenstates into mass eigenstates. 

The theoretical value for Qw for the Cesium atom is given by [21| Qw(H 3 Cs) = — 73.17± 
0.03 + AQw, where the contribution of new physics is included in AQ W and can be written 



as 122. 23 



AQ 



ir 



l + 4 : 



C4 
°W 



oo2 



N 



p v + AQ' W , 



(42) 



where 



AQ', 



+ 



16[(2Z + N)(g(e) 1A g(u) 2V + g{e) 2A g(u) w ) 
(Z + 2N)(g(e) 1A g(d) 2 v + g(e) 2A g(d) lv )} sin6 
16[(2Z + N)g(e) 2A g(u) 2V 



+{Z + 2N)g{e) 2A g{d) 



2V 



■Ml 
Ml 



(43) 



The term AQ' W is model dependent. In particular, it is a function of the couplings g(q) 2 v 
and g(q) 2A (q = u,d) of the first family of quarks to the new neutral gauge boson Z 2 . So, 
the new physics in AQ' W depends on which family of quarks transform differently under the 
gauge group. For each assignment in Table UTt we get the following values for AQ' W in Model 
A 



Assignments Al, A2: 

AQ' W = (10.63Z + 6.99A0 sin 9 



+ (4.94Z + 4.18A0 



Mi 
z i 

z 2 



(44) 



Assignment A3: 

AQ' W = (-5.51Z-9.15A^)sin^ 



M'i 



-2.66^-3.42^)-^, 



(45) 



while in Model B, for which there is not family dependence in the fermion couplings to Z\ 
and Z 2 , we obtain 



AQ' W = (3.66Z + 2.51A0 sin^ + (-1.18Z - 0.39A0 



Ml 
Ml 



(46) 



The discrepancy between the SM and the experimental data for AQ W is given by [21[ 

AQ W = Qw v ~ Qw M = 0-45 ± 0.48, (47) 
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FIG. 1: Contour plot displaying the allowed regions for 9 vs M z , 2 at 95% C.L. for Model A and for 
the three assignments in Table 2. The crosses locate the best fit values. 



which is 1.1 a away from the SM predictions. 

Using the couplings g^ k \f)iv and 9^(f)iv (k = A, B, i = 1,2) for each model, introduc- 
ing the expressions for Z-pole observables in Eqs. (1551) . (157)) . (155)) and (HOI) , and with AQ W 
in terms of new physics in Eq. ( 1421) . and using experimental data from LEP, SLAC Linear 
Collider and atomic parity violation (see Table HX)) . we do a x 2 fit and find the best allowed 
region in the (9 — M Z2 ) plane at 95% confidence level (C.L.). 

In Fig. [1] we display this region for each assignment in Model A. From this figure we get 
the family- dependent constraints 

Assignment Al: 

-0.00004 < 9 < 0.00094, 2.03 TeV < M z , 2 , (48) 
Assignment A2: 

-0.00008 < 9 < 0.00087, 2.03 TeV < M z . 2 , (49) 
Assignment A3: 

-0.00019 < 9 < 0.00062, 2.31 TeV < M z . 2 , (50) 

For Model B the allowed region is shown in Fig. [21 which produces the family-independent 
constraints [24j 

- 0.00039 < 9 < 0.00139, 0.89 TeV < M Z2 . (51) 
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-0.5 0.5 1 1.5 

e (xio -3 ) 

FIG. 2: Contour plot displaying the allowed region for 9 vs Mz 2 at 95% C.L. for Model B. The 
cross locates the best fit values. 

For Model A the allowed region in the (9 — Mz 2 ) plane depends on which generation of 
quarks transforms differently under SU(4)l® U(1)x- So, for this model the phenomenology 
depends crucially on the family assignments in Table [TTl For example, Eqs. (|48|) and (|49p 
show that the second family or the third one must be different in order to keep the bound 
on M Z2 as low as possible. 

Unlike Model A, for Model B the allowed region in the (6 — Mz 2 ) plane does not depend 
on the quark family assignments in Table IVII This is a consequence of the family-universal 
character of the couplings in Tables IVHI and IVIIIl which in turn comes from the fact that 
in this model the three quark families have the same hypercharge X. 

It must be stressed that for both models the constraints on Mz 2 are compatible with the 
bound obtained in pp collisions at the Fermilab Tevatron [25( . 

B. Bounds from FCNC processes 

The discrete Z 2 symmetries introduced in Models A and B not only produce a simple 
mass splitting between ordinary and exotic fermions, but also avoid unitarity violation of 
the CKM matrix arising from their mixing. Since each flavor couples to more than one Higgs 
4-plet, FCNC coming from the scalar sector are also present. Because this last contribution 
depends on a large number of arbitrary parameters, is not very useful in order to constrain 
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the model and we will ignore it. Because the right-handed quarks transform as SU(4)l 
singlets, they are generation universal and, consequently, they couple diagonally to the 
neutral gauge bosons. However, there is an additional source of FCNC due to the fact that 
anomaly cancellation among the families forces us to have one family of left-handed quarks 
in the weak basis transforming differently from the other two. 

Regarding the left-handed interaction of quarks, Eqs. (TTBT) and (IHTj) show that the cou- 
plings to the Z boson remain flavor conserving for both models. Then, neglecting the scalar 
contribution and because of the Z2 symmetry, the only source of FCNC is in the left-handed 
interactions of ordinary quarks with the new neutral gauge boson Z' in Model A and with 



Z" in Model B. For their study we will follow the analysis presented in Refs. [26|, |27| where 
bounds coming from neutral meson mixing are obtained in the context of the so-called 
"minimal 3-3-1 model", which is a model with extra quarks having exotic electric charges. 



1. Model A 

With b = c = 1 and from the charge operator in Eq. (JTJ, the Y hypercharge of the SM is 
given by Y/2 = T$l/V3 + Ti 5L /^/6 + X. In terms of Y, the couplings of Z' to left-handed 
quarks in Eqs. (1141) and ( flTj) . can be written in a more convenient fashion for 4-plets as 

= Ji r / 1 o2 %nZ'), (52) 

with 

J^(Z') = J2 mVQS 2 w Y - AC 2 w T L ]P L f. (53) 
/ 

where Pl is the left-handed projector and Tl = V2T 8 l + Ti 5 l- 

The value of the operator Tl is not the same for 4-plets than for 4*-plets. Then, the 
flavor changing interaction can be written, for ordinary up- and down-type quarks q' in the 
weak basis, as 

■H^Ofcnc = -4C^5>V[Tl(4) - T L (A*)]P L q'. (54) 



Using (1521) and (J54J) we have 



g a 



2 



£(Z')fcnc = - ^ W (singzr + cos^) 

xE«Vi?' (55) 



where, by using Eq. ( flOl) . we have included the mass eigenstates Z\ and Z 2 . 

In order to consider constraints coming from experimental data in the K° — K°, B^ — B^, 
B° s — B° s and D° — D° systems, we first notice that the submatrices M^ x3 and Mg x3 in 
Eqs. © and are diagonalized by biunitary transformations Ul,r and Vl,r, respectively, 
with Vckm = U\Vl being the CKM mixing matrix. Then, in terms of mass eigenstates, 
Eq. fl55l) produces the following effective Hamiltonian for the tree-level neutral meson mixing 
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interactions 



*j(a,P) _ ZVZGpCly cos 2 6 2 
n eG - 2 _ 35<2 K V Lja V Lj0) 

M 2 \ 

J ^ + ta n 2 ej[a lfl P L (3] 2 , (56) 

where (a, (3) must be replaced by (d,s), (d,b), (s,b) and (u,c) for the K° — K°, B® — 
B° s — B° s and D° — D° systems, respectively, and Vl must be replaced by Ul for the neutral 
D° — D° system. The family index j = 1, 2, 3 refers to the family of quarks to be singled 
out as transforming differently. 

The effective Hamiltonian gives the following contribution to the mass difference ArriK 

Am K AV2G F C^cos 2 e 2 

"^T = 3(2-3^) Re ^ V ^ 1 

/ M 2 \ 
x VK ^+tan 2 9jB K f K , (57) 

while for the B® — B®, B® — B° s and D° — D° systems, we have 

Am B 4V2G fC^ cos 2 9 |T „ 2 
m B ~ 3(2-3^) l^^l 
(M\ 
4 



f M 2 \ 

+ tan 2 0)B B f I (58) 



Amp 4y/2G F Ctcos 2 fl 

3(2-3^) l ^^ c| 



/M 2 

x V d[j^+ tan 2 6 jB D f 2 D , (59) 

where B stands for B^ or B s . B m and f m (m = K,Bd-,B sl D) are the bag parameter 
and decay constant of the corresponding neutral meson, respectively. The 77's are QCD 
corrections which, at leading order, can be taken as equal to the ones of the SM (28[, that 
is: r] K ~r] D ~ 0.57, rj Bd = Vb s ^ 0.55 @. 

Several sources, different from the tree-level Z2 exchange, may contribute to the mass dif- 
ferences and it is not possible to disentangle the Z2 contribution from other effects, because 
of this, several authors consider reasonable to assume that the Z2 exchange contribution 



must not be larger than the experimental values [26j. In this work we will assume that this 
is the case. We must notice, however, that more conservative but rather arbitrary criteria 
have been used by other authors (28| . 

Since the complex numbers Vuj and Unj cannot be estimated from the present exper- 
imental data, and in order to compare with the bounds obtained in the previous section, 
we assume the Fritzsch ansatz for the quark mixing matrix [30j|, which implies (for i < j) 

Vuj = Jmi/rrij, and similarly for Ul [H[ {CP violating phases in the mixing matrices 
will not be considered here). To obtain bounds on Mz 2 from Eqs. (1571) . (1351) and (1591 . we 
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TABLE X: Values of the experimental and theoretical quantities used as input parameters for 
FCNC processes. 





\/ a Inp 

V (l 1 uc 


-L LCLCL Clll^O 


Am ts rnpvi 


O.^OOIUI A lu 


[51 
l°J 


m r^n fMpVl 
i ivxc v j 


4Q7 fi c i('9 N l 






1 43(7") 




L ^' n B d [PS J 


n 508f4 N ) 




,n B d |V« v j 


^ 9704^ 
u.^i i ty-ty o j 


[51 

mi 


f Bd y/B Bd [MeV] 


214(38) 


[32] 


L ^' n B s [P» J 


1 7 77(4 9"l 


[331 

[ J 


m Bs [GeV] 


5.370(2) 


[5] 


f B ,y/B Bs [MeV] 


262(35) 


m 


i±rri£) [ps j 


1 1 7ffi 8 s ! v 1 n~ 3 

11./ ^U.O J A 1U 


L J 


m^o [GeV] 


1.8645(4) 


[5] 


f D ^/BE [MeV] 


241(24) 


[35] 


m w (M z ) [MeV] 
m c (M z ) [MeV] 


9 oq+0.42 

677±|f 




m t (M z ) [GeV] 
m d (M z ) [MeV] 
m s (M z ) [MeV] 


181 ± 13 
4 6Q+ - 60 
QS 4+11-8 




m 6 (M z ) [GeV] 


3.00 ±0.11 


[36] 



use updated experimental and theoretical values for the input parameters as shown in Ta- 
ble 1X1 where the quark masses are given at Z-pole. For Model A and for the three different 
assignments in Table [III the results are 



Assignment Al 
K°-K° 

R° R° 
B d ~ B d 

B° s - B° 
D°-D° 



M Z2 > 3.66 TeV, 
M Z2 > 11.34 TeV, 
M Z2 > 10.56 TeV, 

M Z2 > 0.18 TeV. 



(60) 



Assignment A2 
K°-K° 

R° RO 


s 




D° 



B 
D 



M Z2 > 118.63 TeV, 
M Z2 > 11.34 TeV, 
M Z2 > 10.75 TeV, 
M Z2 > 47.84 TeV. 



(61) 



Assignment A3 
K°-K° 

R° R° 
B d ~ B d 

B° s - Bl 

D°-D° 



M Z2 > 118.63 TeV, 
M Z2 > 11.34 TeV, 
M Z2 > 0.53 TeV, 
M Z2 > 47.84 TeV. 



(62) 
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This shows that the bounds on Mz 2 coming from FCNC are also family dependent. For 
the assignment Al, the strongest constraint comes from the B% — B^ system which reduces 
the parameter space 9 — Mz 2 by raising the lower bound on Mz 2 to a value larger than 11.34 
TeV, as compared with the bound in Eq. (T4"8"j) . For the assignments A2 and A3, instead, the 
strongest constraint comes from the K° — K° system which raises this bound to a very large 
value greater than 118.63 TeV, as compared with the bounds in Eqs. (I4"9"j) and (loll . Since 
the assignment Al singles out the third family to be different, this must be the case if we 
want to keep the lower bound on the Z 2 mass as low as possible. 



2. Model B 

As already stated, FCNC in Model B are present only in the Lagrangian for the neutral 
current Z^" = Z% which can be written, for 4-plets, as 

£(Z S ) = --^3%(Z 3 ), (63) 

with 

J»(Z 3 ) = "£fYT L P L f, (64) 
/ 

where again Tl = V%T 8L + Txsl- Then, for ordinary up- and down-type quarks q', the flavor 
changing interaction is given by 

J m (Z 3 )fcnc = £<M7i(4) _ T L (4*)]P L q', (65) 
<?' 

so that 

£(Z 3 ) FC nc = -4=Zg £ q%P L q'. (66) 
v2 q , 

In terms of mass eigenstates, this Lagrangian produces the following effective Hamiltonian 
for the tree-level neutral meson mixing interactions 



,MJ 



= V2G F C 2 w {V^ L]P f^[a llx P L (3f : (67) 



with the same meaning for (a, ft) as before, 
e contri 

and D° — D° systems are given, respectively, by 



The contribution from to the mass differences in the K° — K°, B® — B° s — B° s 



Am K . 2V2G f C 2 Wt} , 2l 



-M(V£ jd v Ljs 

Ml 

x V Kj ^B K f K , (68) 
Am B 2^2G F C 2 W |2 



m B 3 

M 2 



'Lja v Ljf3\ 



x VB ^B B f 2 B , (69) 



Ml 
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ArriD 



2\p2G fC"w 



ut ju u L jc\ 



Ml 



2 



(70) 



where again B stands for B d or B s . 

Assuming the same contribution to the mass differences from the Z 3 exchange as from 
the Z2 exchange in Model A, and the Fritzsch ansatz for the quark mass matrices, the 
input parameters in Table |X] give the following lower bounds on the Z 3 mass for the three 
assignments in Table IVII 



Assignment Bl 
K°-K° 
B° d ~ B° 
B° s - B° 
D°-D° 



M Z3 > 2.39 TeV, 
M Z3 > 6.61 TeV, 
M Za > 6.16 TeV, 
M Za > 0.16 TeV. 



(71) 



Assignment B2 



K° 


-K° 


B° d 


-m 


B° s 


-B° s 


D° 


— D° 



M Za > 76.67 TeV, 
M Z3 > 6.61 TeV, 
Mz 3 > 6.16 TeV, 
M Zs > 44.04 TeV. 



(72) 



Assignment B3: 

K°-K° : M Zs > 76.67 TeV, 
B° d -B° d : M Za > 6.61 TeV, 
B° s - B° s : M Z3 > 0.31 TeV, 

D°-D° : Mz 3 > 44.04 TeV. (73) 

Evidently, these results show a lower bound on Mz 3 depending on which family of quarks 
in Table IVl is assigned to the 4*-plet. For the assignment Bl, according to which the heaviest 
family of quarks transforms differently, the strongest constraint is imposed by the B® — B® 
system which gives the lower bound Mz 3 > 6.61 TeV. For the assignments B2 and B3, 
which pick up the second and first family of quarks, respectively, the strongest constraint, 
Mz 3 > 76.67 TeV, is provided by the K° — K° system. This shows that in Model B, like 
in Model A, the third family of quarks must transform differently in order to get, in the 
present case, the smallest lower bound on the Z 3 mass. Since Mf 3 = (gf/2) (V 2 +v 2 ), we 
also have a lower bound on the scale of breaking of the 3-4-1 symmetry. 

Interestingly, the bound from the B® — B® system, both in Models A and B, is not family 
dependent. 
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IV. SUMMARY AND CONCLUSIONS 



We have studied the impact of family dependence derived from quark family nonuni- 
versality on the parameter space 9 — Mz 2 of anomaly-free extensions of the SM based on 
the gauge group SU(3) C <8> SU(A) L ® U(l)x, which do not contain exotic electric charges. 
This last constraint picks up two classes of models characterized, respectively, by the values 
6 = c = 1 and 6=1, c = —2 for the parameters in the electric charge generator in Eq. ([T]) 
12|. Quark family nonuniversality is present in these models because anomaly cancellation 



among the families requires us to have one family of quarks to transform differently from 
the other two under the gauge group. 

Models based on the 3-4-1 symmetry predict the existence of two new neutral currents Z' 
and Z" which mix up with the ordinary SM neutral current associated to the Z boson. For 
models without exotic electric charges, the mixing can be constrained to occur between Z 
and Z' only, so that Z" = Z 3 is a mass eigenstate jlBL 16 . 17| . Quark family nonuniversality 
generates two related effects: it leads to family-dependent left-handed couplings of quarks 
to the new neutral gauge bosons Z' and Z" which are, in general, flavor nondiagonal thus 
leading to FCNC at low energy, and produces weak couplings of quarks to the neutral 
currents Z\ and Z2 (the mass eigenstates associated to the Z — Z' mixing) which depend on 
the family of quarks singled out as the one transforming differently. 

Family dependence has been studied in this paper by identifying the three possible as- 
signments of quark families in the weak basis into quark families in the mass basis. For 
the analysis we have selected two representative 3-4-1 models: Model A in the main text 
belongs to the class for which b = c = 1 12, 15, T^, and Model B belongs to the class for 



which 6=1, c = —2 [l2, 13, 18]. In Model A the Z 3 current couples only to exotic fermions, 
while the left-handed couplings of Z' to the SM quarks are flavor nondiagonal. In Model B, 
instead, ordinary quarks couple diagonally to Z', but nondiagonally to Z3. 

For Model A the three different assignments give three different allowed regions in the 
parameter space 9 — Mz 2 (obtained from a fit to Z-pole observables and to APV data), thus 
producing different predictions for the lower bound on the Z2 mass and for the range of 
values of the [Z — Z') mixing angle 9. These bounds have been further constrained by using 
experimental data from neutral meson mixing in the analysis of FCNC effects associated 
to quark family nonuniversality. For their study we have assumed the Fritzsch ansatz for 
the quark mixing matrix. The resulting new bounds show family dependence through the 
entries of the quarks mass matrices Vi and Ul to be replaced into the formulas for the mass 
differences in the K° - K°, B° d - B% B° s - B° s and D° - D° systems (see Eqs. (ETJ), ([58]) 
and (|59p ). Combining both type of constraints leads to the conclusion that the heaviest 
family of quarks must transform differently in order to have a lower bound on Mz 2 as small 
as possible. For Model A the smallest lower bound comes from the B d — B® system and 
turns out to be Mz 2 > 11.34 TeV, which raises in 1 order of magnitude the lower bound 
Mz 2 > 2.03 TeV obtained from the allowed region in the parameter space 9 — Mz 2 - It must 
be, in any case, recognized that the bounds from neutral meson mixing are always obscured 
by the lack of knowledge of the mixing matrix entries and by the rather arbitrary assumed 
contribution of the Z2 exchange to the mass differences. 

Model B has the particular feature that, notwithstanding two families of quarks transform 
differently under the SU(4)l subgroup, the three families have the same hypercharge X with 
respect to the U{l)x subgroup. As a consequence, the couplings of the fermion fields to the 
neutral currents Z\ and Z 2 are family universal. Thus, the allowed region in the parameter 
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space 6 — Mz 2 is the same for the three different assignments of quark symmetry eigenstates 
into quark mass eigenstates, and gives the family-independent bounds: Mz 2 > 0.89 TeV 
and -0.00039 < 9 < 0.00139. Since FCNC are present for this model in the left-handed 
couplings of ordinary quarks to the Z 3 gauge boson, the contribution of the Z 3 exchange to 
the mass differences in neutral meson mixing produces the family-dependent constraints on 
the Z 3 mass given in Eqs. (ITTj) . (1721) and (1731 . These results allows us to conclude that, like 
in Model A, the third family of quarks must transform differently in order to get, in this 
case, the smallest lower bound on Mz 3 which comes from the — system and turns out 
to be Mz 3 > 6.61 TeV. Since M| 3 = (gl/2)(V 2 +v 2 ), this is also a lower bound on the scale 
of breaking of the 3-4-1 symmetry. As mentioned above, it must be stressed that the bound 
on Mz 3 depends on inputs which are not dictated by the present experimental data, namely, 
the assumed ansatz for the quark mass matrices entries and the assumed contribution of the 
Z 3 exchange to the mass differences in the neutral meson mixing systems. 

The convenience of distinguishing the heaviest family of quarks could give some indication 
as to why the top quark is unbalancingly heavy. 

A comparison of the predictions from the two classes of 3-4-1 models without exotic 
electric charges shows that models for which 6 = 1, c = —2 are preferred in the sense that 
they give lower bounds on the mass of the new neutral gauge bosons Z2 and Z 3 smaller than 
the ones predicted by models in the b = c = 1 class. In fact, first, the family-independent 
lower bound M2 > 0.89 TeV in Model B is not affected by the constraints coming from 
FCNC data and is just below the TeV scale and, second, providing the third family of 
quarks transforms differently, the lower bound on the Z 3 mass is M Zz > 6.61 TeV, a value at 
the reach of the CERN LHC capability. This means that the b = 1, c = —2 class of models 
have a better chance to be tested at the LHC facility or further at the ILC. 

Even though we have constrained ourselves to the particular case V ~ V, v' ~ v, for 
which the mixing is present between the neutral gauge bosons Z and Z' only, the analysis 
presented shows clearly the main purpose of this work, that is, the dependence of the pre- 
dictions of 3-4-1 models on the possible quark family assignments associated to quark family 
nonuniversality. The extension to the general case of mixing between the three neutral cur- 
rents present in the models would complicate the mathematical and numerical analysis, but 
the general conclusions regarding family- dependence of the phenomenology of 3-4-1 models 
would be the same. 

Finally we note that, in order to make evident the effects of quark family nonuniversality, 
we have quoted only the lower bounds on Mz 2 in Eqs. ( 148|) - (!5T|) . As it is clear from Figs. [1] 
and [2j the x 2 fit a l so produces finite upper bounds on Mz 2 which depend on the allowed 
value of the mixing angle 8, except in the limit \8\ — > where Mz 2 can be arbitrarily 
large. This is a characteristic feature both of 3-3-1 and 3-4-1 models without exotic electric 
charges associated to the fact that, if we consider the basic field content only, then the 
renormalization group equation analysis shows that, for all these models, the scale of gauge 
coupling unification Mq can be as high as the Planck scale. This result can be modified in the 
3-3-1 extension, for example, by considering SU(6) as a covering group, and by introducing 
new physics at a scale My « 2.0 TeV < M G « 3.0 x 10 7 GeV (where M v is the scale of 
the 3-3-1 symmetry breaking) in the form of an enlargement of the scalar sector with an 
appropriate lar ge n umber of Higgs fields that do not develop vacuum expectation values (for 
details see Ref. 37]. See also Ref. 38| for an alternative approach). This, clearly, prevents us 
to directly from getting an upper bound on the scale of the 3-4-1 symmetry breaking from the 
fit. Also, the constraints coming from FCNC processes allows us to put only lower bounds 
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on the mass of the new neutral gauge bosons. Then, if we look only to these constraints, 
the 3-4-1 theory we have studied is not more predictive than generic grand unified theories 
where FCNC may also be suppressed by large masses. Notice, however, that bounds on other 
parameters can be obtained by examining additional phenomenological consequences of the 
model. For example, by taking into account that the 3-4-1 extension predicts new heavy 
particles and, provided these new particles feel the electroweak interaction, they should give 
corrections to electroweak precision measurements through their effects on the W and Z 
vacuum polarization amplitudes, which are usually expressed in terms of the oblique S, T 
and U parameters. It can be shown that in the general case V 7^ V, v ' ^ v, the symmetry 
breaking pattern in Eq. (j2J) induces mass splitting between the new heavy gauge bosons 
different from Z' and Z", and mass splitting between the extra heavy Higgs fields arising 
from the diagonalization of the scalar sector [lfjj, so these new particles may give no negligible 
contributions to the oblique parameters. A detailed study of these contributions, which we 
postpone to a future work, will enable us to put upper and lower bounds on their masses. 
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